Tracking Contours of Orofacial Articulators from Real-Time MRI of Speech

نویسندگان

  • Mathieu Labrunie
  • Pierre Badin
  • Dirk Voit
  • Arun A. Joseph
  • Laurent Lamalle
  • Coriandre Vilain
  • Louis-Jean Boë
  • Jens Frahm
چکیده

We introduce a method for predicting midsagittal contours of orofacial articulators from real-time MRI data. A corpus of about 26 minutes of speech has been recorded of a French speaker at a rate of 55 images / s using highly undersampled radial gradient-echo MRI with image reconstruction by nonlinear inversion. The contours of each articulator have been manually traced for a set of about 60 images selected – by hierarchical clustering – to optimally represent the diversity of the speaker articulations. The data serve to build articulator -specific Principal Component Analysis (PCA) models of contours and associated image intensities, as well as multilinear regression (MLR) models that predict contour parameters from image parameters. The contours obtained by MLR are then refined, using the local information about pixel intensity profiles along the contours’ normals, by means of modified Active Shape Models (ASM) trained on the same data. The method reaches RMS of predicted points to reference contour distances between 0.54 and 0.93 mm, depending on articulators. The processing of the corpus demonstrated the efficiency of the procedure, despite the possibility of further improvements. This work opens new perspectives for studying articulatory motion in speech.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Combined cine- and tagged-MRI for tracking landmarks on the tongue surface

Magnetic resonance imaging (MRI) techniques have been a promising way in recent speech production studies, and dynamic magnetic imaging with repetitive or real-time MRI scans has been widely used to acquire motions of all the articulators and measure their deformation during speech. While MRI is capable to visualize the entire surfaces of those organs, it lacks landmarks for motion tracking tha...

متن کامل

Development and implementation of fiducial markers for vocal tract MRI imaging and speech articulatory modelling

MRI allows characterizing the shape and position of speech articulators, but not tracking flesh points, since there are no physiological landmarks reliably associated with the highly deformable tissues of these articulators. This information is, however, interesting for studying the biomechanical properties of these organs as well as for modelling the relations between measurement modalities su...

متن کامل

Visual articulatory feedback for phonetic correction in second language learning

Orofacial clones can display speech articulation in an augmented mode, i.e. display all major speech articulators, including those usually hidden such as the tongue or the velum. Besides, a number of studies tend to show that the visual articulatory feedback provided by ElectroPalatoGraphy or ultrasound echography is useful for speech therapy. This paper describes the latest developments in aco...

متن کامل

Critical Articulators Identification from RT-MRI of the Vocal Tract

Several technologies, such as electromagnetic midsagittal articulography (EMA) or real-time magnetic resonance (RTMRI), enable studying the static and dynamic aspects of speech production. The resulting knowledge can, in turn, inform the improvement of speech production models, e.g., for articulatory speech synthesis, by enabling the identification of which articulators and gestures are involve...

متن کامل

Flexible retrospective selection of temporal resolution in real-time speech MRI using a golden-ratio spiral view order.

In speech production research using real-time magnetic resonance imaging (MRI), the analysis of articulatory dynamics is performed retrospectively. A flexible selection of temporal resolution is highly desirable because of natural variations in speech rate and variations in the speed of different articulators. The purpose of the study is to demonstrate a first application of golden-ratio spiral...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2016